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1. Introduction. 

Let X\, . . . ,X n G (M, r) be a family of non- commutative random variables in a tracial 
W / *-probability space, and let B C M be a unital subalgebra. Voiculescu has introduced in 
|7| a free entropy quantity 

X *(X 1 ,...,X n :B). 

His approach involved non-commutative Hilbert transform and is algebraic in nature. In the 
case that B — C, this quantity is denoted x*(Jfi, . . . , X n ), and its properties are very similar 
to those of the free entropy x{Xi, • • • , X n ) introduced by Voiculescu in Q using microstates; 
in fact, it may very well be that the two quantities coinside. 

Using the microstates approach to free entropy, we introduce in this paper a quantity 
x(Xi, . . . , X n \B) which has several properties in common x*(Xx, ■ ■ ■ , X n : B). 

The infinitesimal change of variables formula for x involves conjugate variables, introduced 
by Voiculescu in order to define x* ■ Both x an d X* have the same behavior under compression 
by matrix units in the case that B = M n ®D, where M n is the algebra of n x n matrices. This 
behavior is a useful technical tool; for example, it was used to prove certain maximization 
results for matrices of non-commutative random variables in 

If the Xi, . . . , X n are free from B, we have 

X (X 1 ,...,X n \B)=x(X 1 ,...,X n ), 

provided that B can be embedded into the ultrapower of the hyperfinite Hi factor; a similar 
fact holds for x* ■ 

If Xi, . . . , X n are free from the algebra generated by Y~i, . . . , Y m and B, then 
X (Xt, . . . , X n , Yl, . . . , Y m \B) = x(X x , ...,X n \B)+ X (Y u ..., Y m \B); 

a similar fact holds for x* ■ 

We prove a maximization result for x (which is essentially identical to the one for 
namely xi^-it ■ ■ ■ ■> X n \B) attains its maximum among all Xi, . . . , X n with ^ T {Xf) = n if 
and only if X\, . . . , X n is a free semicircular family, free from B (we need as an assumption 
that B can be embedded into the ultrapower of the hyperfinite Hi factor). Lastly, the 
infinitesimal change of variables formula for x{' ■ ' \B) involves conjugate variables used to 
define : B) (see 0). 

It is interesting to note that x{'\B) has an interpretation as a relative entropy, which 
suggests a similar interpretation for %*(• : B). Indeed, we show that if Y±, . . . ,Y m are 
generators of B, then x(Xi, • • • , X n \B) = x{Xi, • • • , V^IY - !, . . . , Y m ), where the latter entropy 
has properties of a relative entropy of X±, . . . , X n and Yi, . . . , Y m . We caution the reader 
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2 DIMITRI SHLYAKHTENKO 

that we use a definition of x{Xi, • • • , X n \ Yi, . . . , Y m ) which may be different from the one 
used by Voiculescu in Q, although the two quantities are related. 

2. Relative Free Entropy x(-\B). 

Let (M, r) be a tracial non-commutative probability space, and consider self-adjoint non- 
commutative random variables Xi, . . . , X n , Yi, . . . , Y m G M. We denote by Mk the algebra 
of h x h matrices, and by M| a the set of self-adjoint k x k matrices. Recall that the set 

F R (X 1 ,...,X n ;k,l,e) C (M?) n 

was defined by Voiculescu in J| as the set of those (x\, . . . , x n ) G (M| a ) n , for which ||a;j|| < R 
and for any p < I, and all ii, . . . , i p 

\T n (x il ,...,x ip ) -r(X h ...X ip )\ < e. 
Here r n stands for the normalized trace on the matrices (so that r n (l) = 1). 
Definition 2.1. For yi, . . . ,y n G .1 //,.. define 

T R (Xi, . . .,X n \y u . . . ,y m [Y h . . . , Y m ]; fc,Z,e) 
= {xi, . . . , x n G (Mf ) n : (xi, . . . , x n , yi, . . . , y m ) 
G rfl(Xx, • • • , X n , Y 1; . . . , Y m ; fc, /, e)} 

Remark 2.2. Note that for this set to be nonempty, we must have that 

(y 1 ,...,y m ) G T R ((Y U . . . , Y m : X u . . . , X n ; /, k, e). 

This set would be empty if W*(Yi, . . . , Y m ) were not embeddable into the ultrapower of the 
hyperfinite Hi factor. 

Definition 2.3. Let A denote Lebesgue measure on (M| a ) n corresponding to its Hilbert 
space structure coming from the non- normalized trace. Define successively 

(2.1) X R(X 1 ,...,X n \Y 1 ,...,Y m ,l,e) = 

(2.2) lim — sup 

{yi, ...,y m )e 
T R (Yi, ...,Y m ; k,l,e) 

Tl 

(2.3) \og\T R {X U . . . ,X n \y u . . . ,y m \Y u . . . ,Y m ]-,k,l,e) + - log A; 

Xi?(^l; • • • > ■ • • j ^m) = i n f Xr(Xi, • • • , -^nKl) • • • > Y m \ I, €) 

x{X t , . . . ,X n |Yi, . . . , Y m ) = supxr(Xi, ■ ■ -,X n \Y u . . . , Y m ). 

R 

The last quantity is called the relative free entropy of the n-tuple (Xi, . . . , X n ) with respect 
to the m-tuple (Yi, . . . , Y m ). 

If to is a free ultrafilter on N, then one can also define x^iXi, ■ ■ ■ , X n \ Y 1; . . . , Y m ) exactly 
as in fl2.ip, but replacing lim sup by limfc^^. 
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Remark 2.4. It is not clear whether our definition of xO^Ij • • • >^n|^i> • • • >^m) coninsides 
with that of Voiculescu (see |4]]). His definition corresponds to defining 

XR\Xl, • • • 5 ^reKli ■ ■ ■ j Y m \ I, k, e) = 

r , ^r(Xi, . . . ,X n ,Yi, . . . ,Y m ;k,l,e) n 

hm sup log — + - log fc. 

k \Y R {Yi,...,Y m ;k,l,e) 2 

The connection to our definition can be made as follows: let 

f(yi, ...,y m ) = XT R (Xi, . . .,X n \Yi, . . . } Y m [y u . . .,y m ]; k,l,e) 

Then Voiculescu's definition corresponds to taking as Xr(Xi, ■ ■ ■ , X n \Yi, . . . , Y m \ I, k, e) the 
average of / over T R (Yx, . . . , Y m \ I, k, e). It follows that the quantity obtained in our definition 
is bigger than that of Voiculescu. We mention that it is possible to define, in the spirit of [f| 
the relative entropy as 

j X n , Y\ , . . . , Y m 

j Y m . X\ , . . . , X n ) . 

Such a definition corresponds to defining Xr{X\, ■ ■ ■ , -Xni^i> • • • ; Y m ; I, k, e) as the average of 
/ over r R (Yi, . . . ,Y m : X 1: . . . , X n ). We don't know whether x' coincides with Voiculescu's 
or our definition of Xi an d whether Voiculescu's and our definitions are the same or different. 
Note, however, that we always have: 

Proposition 2.5. Let X\, . . . , X n , Yi, . . . , Y m be non- commutative random variables. Then 
we have 

X (X 1 , . . . ,X n , Y x , . . . ,Y m ) - X (Y U ...,Y m )< 

X{Xi, . . . , X n , Yi, . . . , Y m ) — x{Yi, . . . ,Y m : Xi, . . . , X Tl ) < 

X[Xi, . . . , V n |Y"i, . . . , Y m ). 

In particular, if x{Xi, . . . , X n \Y u . . . , Y m ) = -oo, then x{Xi, ■ ■ ■ , X n , Y lt . . . , Y m ) = -oo. 

Proof. In the case that x{Yi, • • • , Y m ) is finite, the inequalities follow from the discussion in 
Remark gl]. If 

x(Y 1 ,...,Y m ) = -oo, 

then 

X(X U ...,X n ,Y 1 ,...,Y m ) = -oo. 

If x(Yi, ...,Y m )^ -oo, then 

x(Xx, . . . ,X n \Y u ...,Y m ) = -oo 

implies that 

x{Xi, ...,X n ,Y h .. .,Y m ) < -oo + x{Yi, . . .,Y m ) = -oo. 



□ 



Notation 2.6. We shall write 

T R (Xi, X n \yx, ...,y m ;l, k, e) 

for 

r fl (Jfi, . . . , X n \yt, . . . , y m [Yi, . . . ,Y m );l,k, e) 
when the Y\, . . . , Y m are understood. 
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Proposition 2.7. If p < m, then x(Xi, ■ ■ ■ , X n \Y u . . . , Y m ) < x( x i, ■ ■ • , X n \Y h . . . , Y p ), 
and a similar inequality holds for xr and x u ■ 

Proof. We have the inclusion 

Y R (X l} . . . , X n \y 1} . . . , y m \Yi, . . . , Y m };l, k, e) C T R (Xi, . . . , X n \y h y p \Y l: . . . ,Y p ];l, k, e) 
for all (yi, . . . , y m ) G M k . It follows that 

sup XT^Xt, . . . ,X n \y u . . . ,y m [Yi, . . . ,Y m ];l,k,e) < 

(Vl,—}Vm) 

sup XT R (Xi, ...,X n \yi,..., y P [Y u . . . ,Y p );l,k, e) 

(itti-ilfo) 

which implies the desired inequality. □ 

Proposition 2.8. X {X U . . . , X n \Y u . . . ,Y m ) < X {X x ,...,X n :Y U . . . ,Y m ). 
Proof. We clearly have 

T R (X h . .., X n ||/i, . . . , y m [Y"i, . . . , Y m ]; I, k, e) C 7iT r (Jfi, . . . , X n , Y h . . . , Y m ; I, k, e), 
where n denotes the projection from (M| a ) n x (M sa ) m onto (M| a ) n . □ 

Corollary 2.9. let c 2 = ^J2 T (X 2 ). Then 

X (X u ...,X n \Y u ...,Y m ) < -log2vrec 2 . 
The same estimate holds for xr and x w - 

Proof. We have x(Xi, • • • , X n , Yi, . . . , Y m ) < x(Xi, ■ ■ ■ , X n ) < ~ log 2nec 2 , the last inequality 
by§. " □ 

Definition 2.10. Let B C M be a unital subalgebra of M. We define the free entropy of 
(Xx, . . . , X n ) relative to B to be 

x(x 1 ,...,x n \B) = M inf y(x 1 ,... J x n |y 1 ,...,y m ). 

m Yi,...,Y m eB 

If is a free ultrafilter on the natural numbers, then we define x u (X\, . . . ,X n \B) in the 
obvious way 

Remark 2.11. For x{Xi, ■ ■ ■ , X n \B) to be finite, we must have that for all Y\, . . . , Y m G B, 

X {X 1 ,...,X n \Y 1 ,...,Y m )^-oo. 

By Remark p.2| , this subsumes that B is embeddable into the ultrapower of the hyperfinite 
Hi factor. 

Proposition 2.12. If D G B is a unital subalgebra, then 

X (X 1 ,...,X n \B)<x(X 1 ,...,X n \D). 

In particular, we have x{Xi, ■ ■ ■ , X n \B) < x{X\, ■ ■ ■ , X n \C) = x{Xi, • • • , X n ). The same 
conclusion holds for x replaced with x^ ■ 

Proof. The first inequality is because in computing x{X\, ■ ■ ■ ,X n \D) we take the infimum 
over a smaller set. The equality between x{Xi, • • • , -^n|C) and x{Xi, • • • , X n ) is left to the 
reader. □ 
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Proposition 2.13. Let X\, i — 1, . . . , n, j — 1, 2, . . . be non- commutative random variables. 
Assume that X±, . . . , X n are such that as j — > oo 7 the joint distribution of (X{, . . . , X^) and 
B converges to the joint distribution of B and X±, . . . , X n . Let Yf , . . . be such that they 
converge in distribution to Yi, . . . , Y rn . Assume that there exists a finite constant R, so that 
su Plj IIX/'II, HXill, \\Yi\\ < R. Then 

X (X U ...,X n \B)> limsup X (X{, ...,Xi\B) 

j 

and 

X (X u ...,X n \Y 1 ,...,Y m )>limsu P x(Xi,...,Xl\Y?,...,Yl). 

j 

The same conclusion holds for x w instead of x- 

Proof. Clearly, only the second inequality needs to be proved. It follows from the following 
inclusion, true for sufficiently large j: 

r R (X(, . . . , Xl\ yi , y m [Y(, Y>\- k, I, e/2) C 
T R (X l , . . . ,X„|yi, . . . ,y m [Yi, ...,Y m ; k,l,e), 

since it implies that 

sup log \T R (X{, . . . , Xl\ yi , . . . , y m [Yi . . . , Y^ k, I, e/2) < 

Vl, — ,Vm 

sup \og\Y R (X u . . .,X n \y u . . .,y m \Yi, ■■■ ,Y m \ k,l,e), 
yi,—,Vm 

which in turn implies the desired inequality. □ 

Proposition 2.14. Assume that Z\, . . . , Z r e W*(Yi, . . . , Y m ). Then 

x(Xi, • • • , ^n|^l, • • • , im) ^ x(Xi, ■ ■ ■ , X n \Z 1 , . . . , Z r ), 
and similarly for x replaced with x w ■ 

Proof. Fix e > 0, / > 0, R > 0. Then there exists non-commutative polynomials p±, . . . ,p r 
in m variables, such that 

(Xi, . . . , X n ,pi(Yi, . . . , Y m ), . . . ,p r (Yi, . . . , Y m )) 

approximate 

(Xi, . . . , X n , Z 1 , . . . , Z r ) 

strongly to any desired accuracy. It follows, that for a suitable choice of such polynomials, 
there exist e>e'>0, Z' > / > and R' > R > such that whenever 

(yi, • • • , Vm) e F R (Y U ...,Y m ,X 1 ,...,X n ;k, I', e) 

we have the inclusion 

r R >(X 1 , . . .,X n \y!, . . .,y m \Yi, ■ . . ,Y m ]; k,l',e') C 
T R (X 1 , X n |pi(j/i, ...,y m ),.. .,p r (yi, ...,y m )[Yi,...,Y m };k, I, e). 
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It follows that 

sup log XT R i(X!, . . .,X n \y x , . . .,y m \Y x , ■ ■ ■ , Y m ]; k,l',e') < 
vi,—>Vm 

sup logXT R (Xi, . . .,X n \z x , . . .,z r [Zi, . . .,Z r ]; k,l,e). 

Zi,...,Z r 

But this implies x{X x , ■ ■ ■ , X n \Y x , ■ ■ ■ , Y m ) < x{X x , . . . ,X n \Z x , . . . , Z r ). □ 

Theorem 2.15. X (X U . . . ,X n \Y u . . . ,Y m ) = X (X X , . . . , X n \W*(Y u . . . , Y m )). 
Proof. By definition, 

X = X (Xi, • • • , X n \W*(Y u ...,Y m )) = inf inf X {X X , X n \Z u Z r ). 

r Zi,...,Z r EW*(Yx,...,Ym.) 

In particular, if r = m and (Z x , . . . , Z r ) = (Y x , . . . , Y m ), we have that 

X <x{X 1 ,...,X n \Y 1 ,...,Y m ). 
But by Proposition |2.14j , we also have that, for Z x , . . . , Z r G W*(Y X , . . . , Y m ), 



X (X U . . . , X n \Y u . . . , Y m ) < X (Xi, ...,X n \Z x ,...,Z r )< X , 
so that x = X( x i, ■ ■ ■ , X n \Y x , . . . , Y m ). □ 

Proposition 2.16. IfY x ,...,Y m e B, then X (X X , . . . , X n \B) < X (X u ...,X n : Y x ,...,Y m ). 

Proof. We have X {X X , • • -,X n \B) < X (X X , . . .,X n \Y x , . . . ,Y m ) < X (X X , . . . , X n : Y x , . . . , Y m ). 

□ 

Theorem 2.17. Let B = L°°[0, 1] C M be a diffuse commutative von Neumann subalgebra. 
For each r = 1, . . . , n let \i r be a measure on [0, l] 2 determined by 

f(x)g(y)dfir(x,y) = r(X r fX r g). 

Assume that for at least one r 6 {l,...,n} ; Lebesgue measure on [0, l] 2 is singular with 
respect to fi r . Then x{X x , . . . , X n \B) = — oo. 

Proof. Let Y be a self-adjoint generator for B. Then we have 

X (X X , . . . , X n \B) = X (X X , . . . , X n \Y) < X {X X , . . . , X n : Y) = -oo 

because of || Corollary 7.7]. □ 

Note that the analogous theorem holds for • • : B), see 0. 

Proposition 2.18. Let p < n. Then 

X (X X , ...,X n \B)< X (X X , X p \B) + X (X m+x , X p \B) 

and a similar inequality holds for x^ ■ 

Proof. We clearly have 

T R (X X , . . .,X n \y x , ...,y m ] k,l,e) C T R (X X , . . .,X p \y x , ...,y m ; k,l,e)x 

Fr(X p+x , . . . , X n \y x , . . . , y m ; k, I, e) 
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so that 



sup log ArofXi , . 


, . , X„ 1 y-\ , . . 


• • Z/n-i • Aj • £ • € ) 

J ty Til ) 1 v J J — 


yi,...,y m 






sup logAfrofX!,. 


. . , X p |t/i, . . 


• • i Vm i % •> ^ ) H - 








log Ar R (x p+1 , . 


• • ,^n|Z/l, • • 


• j Vm] k, I, e) < 


sup log A (T R (Xi, . . 


-,x P \yi, ■ ■ 


.,y m ; k,l,e)) + 


Vl,—>Vm 






sup log A (T R (X P+1 , . 


■ ■ , X nb \yi, . 





yi,—,y m 

This implies the proposition. □ 

Theorem 2.19. Let Xi, . . . , X„, X n+ i, . . . , X p G (M, r) fre self-adjoint non- commutative 
random variables. Assume that the family X x , . . . , X n is free from the von Neumann algebra 
generated by B and X n+ i, . . . ,X P , and assume that B is embeddable into the ultrapower of 
the hyperfinite II\ factor. Then 

x(Xi, . . . ,X n ,X n+1 , . . . ,X P \B) = x{Xi, ■ ■ ■ ,X n ) + x(X n+ i, . . . ,X P \B). 

In particular, 

X (X 1 ,...X n \B) = x(X 1 ,...,X n ). 

The same statements hold for x u . 

Proof. It is sufficient to show that 

x(Xi, . . . , X n ) + x(X n+ i, . . . , X P \B) > x(Xi, . . . , X n , X n+ i, . . . , X P \B). 

Fix m > and elements Y\, . . . , Y m G B. Let yx, . . . , y m G r R (Yi, . . . , Y m ; k, I, e); such an 
m-tuple exists because B can be embedded into the ultrapower of the hyperfinite Hi factor. 
By Voiculescu's result in ||, we have that the ratio 

lim . nf Ar fl (Xi, ...,X n ;k, I, e) x T R (X n+1 , X p \y u y m [Yj, . . . ,Y m ];k,l, e) > 
fc-»oo XTjt(Xi,...,X n ,X n+ x,...,X p \yi,...,y m \Yi,...,Y m ];k,l,e) ~ 

Indeed, given a 5 > 0, there is a ko, for all k > k$ and for each choice of an approximant 

\p^n-\-l , ■ ■ ■ , Xp ) G r R (X n+ i, . . . ,X p \yi, . . . ,y m [Yi, . . . ,Y m ]; k,l,e), 
there exists an open subset 

^k,x„+i,...,x p C r R (Xi, . . . , X n ; k, I, e), 

so that 

XTk,x n+1 ,...,x p ^> I _ 



Fr(Xi, • • • , X n ; k, I, e 
satisfying 

r k ,x n+u ...,x P x {{x n +i, ...,x p )}(Z T R (X 1 , . . . 

, X n , X n+ i, . . . , X p \yi, . . . , y m \Yi, . . . , Y m \; k, I 



2' 



Let O = 0(x n+ %, . . . , x p ) be an open ball of radius e' for the operator norm on p , centered 
at x n+ \, . . . , x p . Then for sufficiently small e' (depending only on k and I), we have 

> X n , X n+ i, . . . , X p \yi, . . . , y m 

j Y m ] , fc, Z, 6) . 
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Let 

Tfe = ^k,x n+u ...x p x 0(x n+ i, . . . , X n ). 

Then T k C r R (X u . . . ,X n ,X n+ i, . . .,X p \y u . . . ,y m \Y x , . . ■ ,Y m ); k,l,e), so that 

XTr(Xi, . . . , X n , X n+ i, . . . , Xplui, . . . ,y m [Yi, . . . , Y m \; k, I, e) > AT*. 
> inf AT^^...^ x XT R (X n+1 , . . . ,X p \yx, . . . ,y m [Yi, . . . ,Y m }; k,l,e) 

>(l-5)- XTniXu X n ; k, I, e) x XT R (X n+1 , ...,X p \ 

2/i 5 • • • > ym[Yi, • • • , Y m y : k, I, e). 
The statement of the theorem follows. The proof for x u is identical. □ 

We note that the preceding theorem implies that xP^i; • • • yX n \B) is not always —00. For 
example, if Si,...,S n is a free semicircular family free from a unital von Neumann al- 
gebra B, which can be embedded into the ultrapower of the hyperfmite Hi factor, then 
x(Si,...,S n |B) = flog27re>-oo. 

Corollary 2.20. Let Xi, . . . , X p be random variables. Assume that Xi, . . . , X n are free from 
the algebra generated by X n+ i, . . . , X p and B. Then 

(2.4) X (X l ,...,X n ,X n+1 ,...,X p \B)= X (X 1 ,...,X n \B)+x(X n+1 ,...,X p \B). 

Proof. If B is embeddable into the ultrapower of the hyperfmite Hi factor, we have by 
Theorem 2.19| that 



1 X n , X n+ i, . . . , X p \B) = X (X U ...,X n ) + X (X n+1 , . . . , X p \B), 

and also that 

X (X 1 ,...,X n \B)=x(X 1 ,...,X n ). 

If B is not embeddable into the ultrapower of the hyperfmite Hi factor, then the quantities 
on both sides of ( |2.4| ) are equal to —00. □ 

The analogy between . . . ,X n \B) and x*(Xi, . . . ,X n : B) makes it tempting to con- 

jecture that ( |2.4j) holds under the weaker assumption that X 1; . . . , X n and X n+1 , . . . ,X p are 



free with amalgamation over B\ however, we were unable to prove this. 

3. Separate change of variables formulas. 

Theorem 3.1. Let fa : R — ► R be diffeomorphisms, and let fa be the distribution of Xi. 
Then 

• • • , f n (X n )\B) = x (Xx, ...,X n \B) + J2j J l0g| ^~^ (t)l d^(a)d/xi(t), 
and the same formula holds for x^ place of x- 



Proof. It is sufficient to prove the statement assuming further that /; are identity diffeomor- 
phisms for i > 1; we write / = f\. It is moreover sufficient to show that given Y\, . . . , Y m G B 

XifliXx), fniXnWx, ...,Y m )> x(Xx, X n \Y h ...,Y m ) + 

log l/QQ -/(*)! ,, f 

— - — : dfi^dfiiit), 

log Is — 1\ 
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since the reverse inequality follows by replacing / with its inverse. It is shown in || Propo- 
sition 3.1] that given 5 > 0, e > 0, I > 0, R > 0, there exist k > 0, e > e > 0, l > I > 0, 
such that for all k > k , < e' < e and I' > l , the determinant of the map 

F : (xx, . . . j ■ ■ ■ i x n , yi, . . . , y m ) 

is bounded below by 

exp(V J J log -6 

for 

(x u . . . ) G r_R/(Xi, . . . , X n , Yi, . . . , Y m ; k,l ,e). 

Moreover, the image of 

Fr'(Xi, . . . , X n , Yi, ... , F m ; /c, e') 
under this map is contained in 

rR{f{Xi), . . . , X n , Yi, . . . , y m ; /c, /, e). 
Choose yi, . . . ,y m such that 

log sup XT RI (Xi, . . . ,X n \zi, . . . ,z m [Y h . . . ,Y m ]; k,l',e')- 

logAr fi /(Xi, . . .,X n \yx, . . .,y m [Yi, . . . ,Y m ); k,l;,e') < 5. 
Then we have that 

sup log XT R >(f(X 1 ),X 2 , ■ ■ -,X n \zx, . . . ,z m [Yx, . . . ,Y m ]; k,l,e) > 

logXT R (f(X 1 ), . ..X n \yi, . . .,y m \Yi, . . ■ ,Y m ]; k,l,e) > 
log \F (T R/ (X U X n \ yi , . . . , y m [Yx, . . . , Y m \; k, l', e')) > 
log\V R/ (Xx, . . .,X n \yi, . . .,y m \Yi, ■ ■ ■ ,Y m ]] k,l',e') 
log|/(«)-/(f)L. ,„ w .. u , xu2 




log \s — 1\ 



-dni(s)d/j,x(t) — 8k > 



log sup XT R/ (Xx,...,X n \zx,...,z m [Yx,...,Y m );k,l',e') 

+ f f ^\f(s)-f(t)\ ^ 
J J log |s — t| 

Taking limsup^^ gives us that 

XR(f(Xx), ■ ■ -,X n \yx, . . .,y m [Yx, . . . , Y m ];l,e) > 
Xr'(Xx, . . -,X n \yx, . . .,y m [Yx, . . . ,Y m );l',e') 

f f log 1/(5) -f(t)\ j . (A 

+ J J log |g — t| W^W*)' 

which implies the theorem. The proof for is exactly the same. □ 

Proposition 3.2. If \\Xi\\ < R for all i, then 

XR (Xx,...,X n \B) = X {Xx,...,X n \B), 

and similarly for . 
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The proof is along the lines of that of Theorem |3.1| , using the ideas of a similar Proposition 
in [HI, and is therefore omitted. 



4. General change of variables formula. 

Let B C M be a unital subalgebra, and let F\,...,F n be non-commutative power series 
with coefficients from B; i.e., 

Fi(tt, ...,t n )=22 Yl b it--Ak t ^ b h,..,i k ■ ■ ■ 

k h,...,ik 

Denote by B[ti, . . . , t n ] the set of all such power series, which have the property that if 
F G B[ti, . . . , t n ] and Xi, . . . , X n are self-adjoint, then F(Xi, . . . , X n ) is also self-adjoint. 
Given F f G B[t 1 , . . . ,t n ] as above, denote by Fi the power series 

Fi^a,...,^) ^ nil 6 *J I .-,iJl^i'--^*- 

fc h,...,i k j=l 

We say that . . . ,R n ) is a mutiradius of convergence of Fi, if it is the multiradius of 
convergence of F (as an ordinary commutative power series). 

Let F G B[ti, . . . , t n ] be such a power series. Then by the derivative of F with respect to 
ti we mean the formal power series DjF G JB[ti, . . . , t n ) <S> B[ti, . . . , t n ]. Here Di is defined by 
the following properties; here we think of B[ti, . . . , t n ] and B\t\, . . . ,t n ) (g) B[t\, . . . , t n ] are 
viewed as bimodules over the algebra generated by B and t\, . . .,t n using its obvious left 
and right actions. 

1. Di is bilinear over the algebra generated by B and t\, . . . , U+x, . . . ,t n ; 

3. D satisfies the Leibniz rule: D^FG) = (DiF)G + F(DiG). 
As an example, 

Di(botib 1 t 2 b 2 tib 3 t A b4 : ) = b <S> b 1 t 2 b 2 tib 3 t A b 4: + bot^t^ ® 6 3 t 4 6 4 . 

Given a family of non-commutative power series Fi, . . . ,F n with a common multiradius 
of convergence . . . , R n ), we define for X\, . . . , X n G M, \\Xi\\ < Ri, its Jacobian at 
Xi, . . . , X n , to be the matrix D B F(Xi, . . . , X n ) G M n ® M ® M whose i, j-th entry is equal 
to D i (F j )(X 1 ,...,X n ). 

Note that if B C and xi, . . . , x n G M^, then Db(x\, . . . , i„) is precisely the Jacobian 
of the map 

(zi,...,z n ) h-> (Fi(zi,...,z„),...,F n (zi,...,z„)), 

evaluated at sci, . . . , x n . 

The proof of the following Theorem is almost identical to the proof of the change of 
variables formula given in ||, together with the line of the proof of Theorem |3.1| , and is 
therefore omitted. 



Theorem 4.1. Let Fi G B[t±, . . . ,t n ], i = 1, . . . ,n be non- commutative power series with 
common multiradius of convergence . . . ,R n ). Assume that there are non- commutative 
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power series Gi, i = 1, . . . , n with common multiradius of convergence (r 1; . . . , r n ), such that 
for all i — 1, . . . , n, 

Fi(Gi(ti, . . . , t n ), . . . , G n (ti, . . . ,t n )) = ti, 
Gi(Fi(t\, . . . , t n ), . . . , F n (ti, . . . , t n )) = ti, . 

Assume that for each i, ||Xj|| < min(rj,i?j). Then 

X {F 1 {X 1} ...,X n ),..., F n (X h X n )\B) = 
X (X U X n \B) + Tr <g> r ® r (log \D B F(X 1} ...,X n )\). 

The same formulas hold for in place of X- 

We deduce that "free Brownian motion" has a regularizing effect on free entropy (compare 
0]). The following proposition follows also from the results of ||, but we could not find its 
exact statement there. 

Proposition 4.2. Let Si, . . . , S n be a free semicircular family, free from the algebra B = 
W*(Xi, . . . , X n ). Assume that B is embeddable into the ultrapower of the hyperfinite Hi 
factor. Then for all t > 0, we have 

x(Xi + y/iSi, ...,X n + ViS n ) > nlog2vret > -oo. 

The same estimate holds for x w ■ 

Proof. By the change of variables formula and Theorem |2.19| , we have 

X (Xi + VtSi, ...,x n + Vts n ) > X (Xi + VtSi, ...,X n + VtS n \B) = 

X (ViSi,...,VtS n ) = ^\og2net. 

□ 

Theorem 4.3. Let Pi,...,P n be non- commutative polynomials in n variables with coeffi- 
cients from B. Assume that x{Xi, ■ ■ ■ , X n \B) > — oo. Then 

jX{Xi + ePi(Xi, ...,X n ),...,X n + eP n (Xi, X n )\B) = 

J^i J{Xi :BVW*(Xi,..., Xi-!, X i+h ..., X n ), P t ), 

i 

where J(Xi : B V W*(Xi, . . . , X i+ i, . . . , X n )) is the first-order conjugate variable to Xi 
with respect to B V W*(Xi, . . . , X i+ i, . . . , X n ) (cf. ^J\). The same equality holds for 

X"- 

Proof. For e > sufficiently small, the transformation F e defined by 

Fi\Xi, . . . , X n ) = Xi + ePi(Xi, . . . , X n ) 

is a non-commutative power series in Xi, . . . ,X n with coefficients from B and satisfies the 
hypothesis of Theorem |4.1| . It follows that 



X (Xi + ePi(X u ...,X n ),...,X n + P n {Xi, X n )\B) = X (X U X n \B) 

+ (Tr ®t®t) log \D B F\Xi, ...,X n )\. 
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Hence the derivative in e of x{Xi + ePi(Xi, . . . , X n ), . . . , X n + P n (X 1; . . . , X n )\B) is equal 
to the derivative of (r <g> r) log \D B F e (X x , . . . , X n )|. Notice that 

A^ £ (Xi, ■ ■ ■ ,X n ) = ki + eDjiP^Xu . . .,X n ), 

so that 

P B (P e )(X 1 ,...,X n ) = / + eM, 
where / is the identity matrix and 

Mij = DiPj{X x , X n ). 

Hence 

(D B (F e )(X 1 , . . . , X n yD B {F'){X l , . . . , X n )) = I + e(M + M* + eM*M). 
Since log(l + i) has a power series expansion around zero, we have that 

l - \og{D B {F e )(Xi, . . . , X n )*P> B (^ e )(*i, • • • , X n )) = I + ~(M + M*) + 0(e 2 ). 
It follows that the desired derivative is equal to 

(r®r) Q[M + M*A = i £V ® r^Ai*)^, . . . , X n ) + (AP*)(*i, • • • ,*n)*) = 

^r®r(A.P l )(X 1 ,...,X n ), 

i 

since Pj maps self-adjoint variables to self-adjoint variables. Hence we have, by the definition 
of the conjugate variable, that 

jX{Xr + eP 1 {X u ...,X n ),...,X n + P n (X 1; . . .,X n )\B) = 
J2( J (Xi ■ B V W*(X U . . . , X_ l5 X m , X n ), P>, 

i 

as claimed. □ 

Recall (see ||) that a function 4>(X X , . . . ,X n ) is said to attain a local algebraic maximum 
at Xi, . . . , X n on the set S = {Xi,...,X n : ^^(Xf) = n}, if for all non-commutative 
polynomials Pj, with coefficients from B there exist €q > 0, such that for all < e < e , 

X\ + ePi(Xi, . . . , X n ) X n + eP n [Xi, . . . , X n , l , 



\X X + eP^Xx, . . . , X n )|| 2 ' ' ' ' ' ||X n + eP n (X 1} . . . , X„)|| 2 

Clearly this is a much weaker requirement than saying that <fi attains a maximum on S at 
Xx, . . . , X n . 

Proposition 4.4. Let B be a von Neumann algebra, embeddable into an ultrapower of the 
hyperfinite II X factor. Then the function (X x , . . . , X n ) i— > x(Xi, . . . , X n \B) attains a local 
algebraic maximum on the set {Xi, . . . , X n : J2i T (Xf ) = n} exactly when X x , . . . , X n are n 
free (0, 1) semicircular variables, free from B. The same statement holds for \ w - 
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Proof. Note that by Corollary |2.9| , we have that a global maximum (and hence a local 
algebraic maximum) is attained by such a semicircular family. Assume that the maximum 
is attained by some family X±, ...,X n . Then x(X 1; . . . , X n |P) attains a local algebraic 
maximum at X 1; . . . ,X n . Therefore, we have that for all non-commutative polynomials Pj 
with coefficients from B 



d 

de^ 



X 1 + eP 1 {X 1 ,...,X n ) 



X n + eP n (Xi, . . . , X n ) 



\X 1 + eP 1 (X 1 ,...,X n )\\ 2 
But this is equal to 



\X n + eP n (Xi, . . . , X n ) H2 



B = 0. 



d X (Xx, X n \B) - log \\Xi + eP^, X n )\\ 2 



de 



^( J(X :5vr(4.., X i+1 , X n )), ^) 

i 

— -Pj(^l, • • • , Xi))- 

i 

It follows that for all non- commutative polynomials Pj with coefficients from B, 
(J(Xi : B V ^*(X 1; . . . , X,.!, X i+1 , X n )), Pi) = (X t , P(X 1; ...,X n )), 
which implies that 

X = J(X : P V W*(X h . . . , X_x, X m , X n )) 

for all z = 1, . . . , n. But by and @, this implies that X 1; . . . , X n are a free semicircular 
family, free from P. □ 



Theorem 4.5. Assume that B is embeddable into an ultrapower of the hyperfinite II\ factor, 
and Y^i=\ T (X?) = n. Then x(Xi, . . . , X n |P) attains its maximal value of n log 2ire if and 
only if Xi, . . . , X n are a free semicircular family, which is free from B. The same statement 
holds for . 

Proof. The condition that x(-^i> • • • )X n \B) achieves a local algebraic maximum is weaker 
than the condition that it achieves its maximum, so if the maximum is achieved, the local 
algebraic maximum is achieved, and Proposition |4]4] applies. Conversely, it was shown in 
Corollary [T9] that the given number is indeed a maximum. □ 

We end with the following theorem, whose proof is identical to that of [§, Proposition 4.3]. 

Theorem 4.6. If x(X|P) = x(X) 7^ —00, then X is free from B. The same statement 
holds for x 1 * 3 ■ 



5. X (X u ...,X n \B®M N ). 

Let Xj°j, i,j = 1, . . . , N, k = 1, . . . ,n be non-commutative random variables, such that 
Xij = X*j, and let P be a unital subalgebra of (M, r) . Then the joint ^-distribution 
of the family {XM U P completely determines and is completely determined by, the joint 
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distribution of the matrices 

/ Yk yk yk \ 

/ A ll A 12 ••• A 17V \ 

yk yk yk 

^21 ^22 • • • <^2N 

i yk yk yk i 

\ JVi ^AT2 • • • NN / 

the matrix units £7y G Mtv (matrices whose only non-zero entry is in the position i,j) and 
the algebra B ® M^v, identified with those matrices that have entries from B. Therefore, 
it is natural to expect a relationship between the free entropy of the entries of the matrix 
relative to B and the free entropy of the matrix relative to the algebra B <g> of -B-valued 
matrices. Such a property is enjoyed by x* (introduced by Voiculescu in 0; this property 
for x* was proved in 0). 
Let us define 



Y 

i j 



i(x* + [xin if<>j 
4,(x*-[x*n ifz<j. 



For u a free ultrafilter (i.e., a homomorphism uj : C(N) — > C), from the algebra of contin- 
uous bounded functions on N), and n G N, define no; to be the free ultrafilter, which as a 
homomorphism from C(N) is given by the composition of w and the map n • /, given by 
(n ■ f)(m) = f(nm). 



Theorem 5.1. LetYnj\Let u be a free ultrafilter. Then 

•J 1 
2 

Moreover, 



X N "({Y£h,j,k\ B ) = N 2 X "(Z U ...,Z n \B® M N ) - N 2 - log iV. 



Proof. Let £L- be as before. Then 



x{{Y£}ij,k) < N 2 X (Z!, ...,Z n \B® M N ) - N 2 -\ogN. 



2 



X "(Z 1 ,...,Z n \B®M N )= inf X UJ (Zi,...,Z n \P 1 ,...,P q ,{E ij } lJ ). 

Here £7^ are not self-adjoint; what we mean by the quantity on the right is the obvious 
extension of our quantity to such a non-self adjoint case. 
We first claim that 

,n 
2 

Assume that k = Nk'. Fix 5 > 0. Choose Q x , . . . , Q s G B <g> M N and R > so that 



X N "({Y£}i,i,k\B) > N\"{Z X , ...,Z n \B® M N ) - N 2 - log tf. 



. . . , Z n |Qi, . . . , Q 9 , {I-:,,},/) >x"{Z u ...Z n \B® M N ) - 5. 

Let (eij) G Tn({Eij} : Zi, . . . Z n , Q x , . . . , Q s ; fe, /, e). Then by a suitable choice of /, e, /c and 
R, we can guarantee that the exists a projection p < en of rank k', [e xx ,p] = 0. Given 5, 
choose qi, . . . ,qs and ey so that 

log XT R (Z X , . . . , Z n \{e i:j }, {qi}[{E i:j }, {Qi}]; k, I, e) > 

sup Y R (Z x ,... i Z n \{fij}[{E i j}\;k,l,e) -5k 2 

{fij)er R ({E ij y.k,i,e) 
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Let p be as before, and identify pM k p with M k i. For (z±, . . . , z n ) G M£, let zfj = peuz k ejip 
and qlj = peuq r ejip. Denote by T = T{ e ..ythe map from M£ to MJ!, n2 given by 
T(z x , ...,z n ) = (//•'/),>. where 

r _{ 1(4 +[4]*) if ^^ 

It follows that for /, k, R sufficiently large and e sufficiently small, we can assume that the 
logarithm of the Jacobian of T is at least —5k 2 . Moreover, given I', R' and e' there exist 
I > I', R> R' and < e < e', such that 

T(T R (Z U Z n \{ eij }, {Qi}]; fe, i, e) C r R ,({yr}|{^}^[{^.} ijr ]; fc', /', e'). 

It follows that 

log Ar^({yr}|{ ?[ .}. jr [{ Q r j}i . r]; ^ r, o > 

log XT(F R (Z 1 , Z n \{e tJ }, {q l }[{E lJ }, {Qi}]; k, I, e) > 
log \T R {Z U Z n \{ eij }, {qi\[{E t] }, {Qi}]; k, I, e) - 5k 2 > 
sup log XT R (Z l7 Z n \{fij}, { Pl }[{E tJ }, {Qi}}; k, I, e) - 25k 2 . 

((fij)i3,(Pr)er R ({E i:i },{Pi}:k,l,e) 

Therefore, remembering that k = Nk' and taking limits as k — > w, we get: 

x^(«}|{9|;-}«r[{Q«}o>];' , ,0 = 

1 7V 2 r? 

(i 77 77 \ 

^logAT^C^H^lyrlWyW]; fc '^ e ') + 2 logA; " 2 logiV J " 

iV 2 lim 1 sup log Ar i? (Z 1 , . . . , Z n \{fij}, {ft}[{^-}, {Qi}]; A;, /, e) 

77 77 

+iV 2 - log fc - N 2 - log JV - 25 = 

77/ 

7V 2 X^(^i, • • • , ^n|{^}, {Q i }) - N 2 - log TV - 25 > 

77/ 

iV 2 X ^(Z 1? . . . , Z n \B ® M^; Z, e) - iV 2 - logiV - 35. 

This implies the claimed inequality. 
Next, we claim that 

,n 
2 

For this, choose Q u . . . ,Q n e B ® M N and R > in such a way that 

XI{Z U . . . , ^IQx, ...Q n , {E l3 }) > X u {Zi, ...,Z n \B®M N )-5. 
Set Qlj = E u Q r Ej\. Choose {q^} G F R ({Qlj}; m, k, e). Assume that 

Then let x^- = y[ J +v / — ly^- Set x r G M k ®M N to be x r = £V x^^-E^-, and put g r = X] 4® 
£y G M fe <g> M n . Then given i?' > 0, /' > and e' > 0, there exist R > R' > 0, I > V > and 



x" w (P«}ij,*|a) > N 2 X "(Z U . . . , Z n \B ® M N ) - iV 2 - log N. 
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< e < e', such that (zi,...,z r ) G T R <(Z 1 , . . . , Z n \{E i:j }, {qi}[{E i:j }, {Qi}}] nk, I', e'). Since 
the map assigning to (yj-) the n-tuple (zi, . . . , z r ) is measure-preserving, we get that 

sup log AlVZi, . . . , Z n \{ eij }, {Qi}];nk, I', e') > 

\og\T R ,(Z l7 Z n \{E tJ }, {q t }[{E tJ }, {Q t }};nk, V , e') > 

iogAr fl ((^)|{^.}[gy^,z,e). 

This implies our claim. 

The proof of the inequality for x instead of \ w is along the lines of the proof of the second 
inequality above, and is left to the reader. □ 
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